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The applicants claimed priority based on provisional application number 60/297572 
filed June 12, 2001 in the names of Bjorn Olstad, Steinar Bjaerum, and Kjell 
Kristoffersen. 

Background of Invention 

[0001] Certain embodiments of the present Invention relate to an ultrasound machine for 
tracking and tagging moving structure. More particularly, certain embodiments relate 
to the tracking and tagging of moving cardiac tissue for visualization of expansion 
and contraction processes of the tissue. 

[0002] Echocardiography is a branch of the ultrasound field that is currently a mixture of 
subjective image assessment and extraction of key quantitative parameters, 
of cardiac wall function has been hampered by a lack of well-established parameters 
that may be used to increase the accuracy and objectivity in the assessment of, for 
example, coronary artery diseases. Stress echo is such an example. It has been shown 
that the subjective part of wall motion scoring in stress echo is highly dependent on 
operator training and experience. It has also been shown that inter-observer 
variability between echo-centers is unacceptably high due to the subjective nature of 
the wall motion assessment. 

[0003] 

Much technical and clinical research has focused on the problem and has aimed at 
defining and validating quantitative parameters. Encouraging clinical validation 
studies have been reported, which indicate a set of new potential parameters that may 
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be used to increase objectivity and accuracy in the diagnosis of, for instance, coronary 
artery diseases. Many of the new parameters have been difficult or impossible to 
assess directly by visual inspection of the ultrasound images generated in real-time. 
The quantification has required a post-processing step with tedious, manual analysis 
to extract the necessary parameters. 

[0004] Assessment of the expansion and contraction of moving anatomical structure is 
no exception. Time intensive post-processing techniques or complex, computation 
intensive real time techniques have been tried in the prior art. 

[0005] A need exists for a simpler, real-time technique for visualization and assessment 
of cardiac wall motion by viewing the expansion and contraction of the cardiac tissue. 

Summary of Invention 

m [0006] An embodiment of the present invention provides an ultrasound system for 
2? generating an image responsive to moving cardiac structure by tracking and tagging 

4? the structure in order to directly visualize the expansion and contraction processes of 

^1 the structure within the image on a display in real time. 

An apparatus is provided in an ultrasound machine for generating an image 
responsive to moving structure of a subject and for generating a representation of 
displacement of the moving structure. In such an environment, a front-end is 
arranged to transmit ultrasound energy into the structure and then to generate 
received signals in response to ultrasound waves backscattered from the structure 
over a period of time, A display is arranged to display the image of the moving 
structure in response to the received signals. A user interface is arranged to enable a 
user of the machine to overlay the image on the display with a first pattern of indicia 
corresponding to sampled anatomical locations within the moving structure. A 
processor is responsive to the received signals to generate parameter signals 
representing displacement of the anatomical locations corresponding to the pattern of 
indicia during at least a portion of the time period and is responsive to the parameter 
signals to generate a second pattern of indicia corresponding to the displacement of 
the anatomical locations and to overlay the second pattern of indicia on the image on 
the display to provide real-time visualization of the displacement. 
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[0008] A method is also provided in an ultrasound machine for generating an image 
responsive to moving structure of a subject and for generating a representation of 
displacement of the moving structure. In such an environment, the method comprises 
transmitting ultrasound waves into the structure and generating received signals in 
response to ultrasound waves backscattered from the structure over a period of time. 
The image of the moving structure is displayed in response to the received signals. A 
user of the machine is able to overlay the image with a first pattern of indicia 
corresponding to sampled anatomical locations within the moving structure. 
Parameter signals are generated representing displacement of the anatomical 
locations corresponding to the pattern of indicia during at least a portion of the time 
period in response to the received signals. A second pattern of indicia is generated 
corresponding to the displacement of the anatomical locations in response to the 
parameter signals and is overlaid on the image to provide real-time visualization of 
the displacement. 

[0009] Certain embodiments of the present invention afford an approach to visualize, by 
using the foregoing techniques, the contraction and expansion of moving anatomical 
structure In real-time with a degree of convenience and accuracy previously 
unattainable in the prior art. 

Brief Description of Drawings 

[0010] Fig. 1 is a schematic block diagram of an ultrasound machine made in accordance 
with an embodiment of the present invention. 

[0011] Fig. 2 is a schematic cross-sectional view of the human heart including 
myocardium tissue. 

[0012] Fig. 3 is a schematic cross-sectional view of the heart shown in Fig. 2 also 

graphically representing mean velocity and mean strain rate profiles as a function of 
time, measured longitudinally in an apical view for a sampled anatomical location in 
accordance with an embodiment of the present Invention. 

[001 3] Fig. 4 illustrates an exemplary ECC signal that may be generated by a timing event 
source and used by the machine in Fig. 1 to identify a time interval in accordance with 
an embodiment of the present invention. 
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[0014] 



Fig. 5 is a flowchart of the longitudinal tracking function executed by the machine 
shown in Fig. 1 that generates the graphs shown in Fig. 7 in accordance with an 
embodiment of the present invention. 



[0015] 



Fig. 6 illustrates displays generated at two different points in time showing tissue 
displacement with patterns of indicia generated by the machine in Fig. 1 using the 
function flowcharted in Fig. 5 in accordance with an embodiment of the present 



invention- 



[0016] 



Fig. 7 shows graphs of a tracked velocity parameter profile and a motion 
parameter profile generated by the tracking function flowcharted in Fig. 5 in 
accordance with an embodiment of the present invention. 



[0017] 



The foregoing summary, as well as the following detailed description of certain 



embodiments of the present invention, will be better understood when read in 
conjunction with the appended drawings. It should be understood, however, that the 
present invention is not limited to the arrangements and instrumentality shown in the 
attached drawings. 

Detailed Description 

[001 8] An embodiment of the present invention enables tracking of moving structure and 
real-time visualization of contraction and expansion of the moving structure. As used 
herein, structure means non-liquid and non-gas matter, such as cardiac wall tissue. 
An embodiment of the present invention offers improved, real-time visualization and 
assessment of the displacement of wall tissue. Displacement may be, for example, 
distance moved by the structure or deformation of the moving structure. The moving 
structure is characterized by a pattern of indicia (set of tagging symbols) overlaid onto 
an image of the moving structure. The characterization of the moving tissue is 
accomplished, in part, by generating a set of signal values derived from movement of 
the structure, such as mean longitudinal velocity. 

[0019] 

Fig. 1 is a schematic block diagram of an embodiment of the present invention 
comprising an ultrasound machine 5. A transducer 10 is used to transmit ultrasound 
waves 7 (solid curves in Fig. 1) into a subject S by converting electrical analog signals 
1 5 to ultrasonic energy, and to receive ultrasound waves 8 (dashed curves in Fig. 1) 
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backscattered from the subject S by converting ultrasonic energy to analog electrical 
signals 16. 

[0020] A front-end 20 connprising a receiver, transmitter, and beamformer, is used to 
create the transmitted waveforms, beam patterns and receiver filtering techniques 
used for the various imaging modes. Front-end 20 performs the functions by 
converting digital data to analog data and vice versa. Front-end 20 interfaces at an 
analog interface to transducer 10 and interfaces at a digital interface over a digital bus 
70 to a non-Doppler processor 30 and a Doppler processor 40 and a host processor 
50. Digital bus 70 may comprise several digital sub-buses, each sub-bus having its 
own unique configuration and providing digital data interfaces to various parts of the 
ultrasound machine 5. 

Non-Doppler processor 30 comprises amplitude detection functions and data 
compression functions used for imaging modes such as B-mode, B M-mode, and 
harmonic imaging, Doppler processor 40 comprises clutter filtering functions and 
movement parameter estimation functions used for imaging modes such as tissue 
velocity imaging (TVi), strain rate imaging (SRI), and color M-mode. The two 
processors, 30 and 40, accept received signal digital data 71 from the front-end 20, 
process the data into sets of signal values 41 (Fig. 3), and pass the values to 
processor 50 and/or a display 75 over digital bus 70. The estimated signal values may 
be created using the received signals 71 in frequency bands centered at the 
fundamental, harmonics, or sub-harmonics of the transmitted signals in a manner 
known to those skilled in the art. 

[0022] Display 75 comprises scan-conversion functions, color mapping functions, and 
tissue/flow arbitration functions, performed by a display processor 80 which accepts 
digital signals 41 (Fig. 3) and 73 from processors 30 and 40. Digital data 72, 
representing a location of a pattern of indicia 1 55, is accepted from host processor 
50. Display processor 80 processes, maps, and formats the digital data for display, 
converts the digital display data to analog display signals 89, and passes the analog 
display signals 89 to a monitor 90. 

[0023] Monitor 90 accepts the analog display signals 89 from display processor 80 and 
displays the resultant image 87 to the operator on monitor 90. 



[0021] 
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[0024] 



A user interface 60 allows user commands to be input by the operator to the 
ultrasound machine 5. User interface 60 comprises a keyboard, mouse, switches, 
knobs, buttons, track ball, and on screen menus (not shown). 



[0025] Host processor 50 is the main, central processor of the ultrasound machine 5 and 
interfaces to various other parts of the ultrasound machine 5 through digital bus 70. 
Host processor 50 executes the various data algorithms and functions for the various 
imaging modes. Digital data and commands may be transmitted and received between 
the host processor 50 and other various parts of the ultrasound machine 5. The 
functions performed by processor 50 may be performed by multiple processors or 
may be integrated into processors 30, 40, or 80, or any combination thereof. 

[0026] In an embodiment of the present invention, an operator uses transducer 1 0 to 
y, transmit ultrasound energy into the appropriate anatomical structure, such as cardiac 

tissue 1 05 (see Fig. 2), of the subject in an imaging mode (such as TVI mode 
interleaved with B~mode) that yields a desired set of signal values 41 (see Fig. 3) of 
the anatomical structure 105. As shown in Fig. 3, the set of signal values 41 typically 
comprises longitudinal estimates of mean tissue velocity 42 and mean tissue strain 
rate 43. 



m 



ffl [0027] Ultrasound energy is received into transducer 1 0 and signals are received into 
m front-end 20 in response to ultrasound waves 8 backscattered from the structure 105. 

p The received signals 71 are sent from front-end 20 to Doppler processor 40 and Non- 

Doppler processor 30 over digital bus 70. Many sets of signal values 41 (such as mean 
velocity 42) and B-mode signals 73 (such as amplitude) are generated from the 
received signals 71 over a segmented time period 45 (Fig. 3) by Doppler processor 40 
and Non-Doppler processor 30. 

[0028] operator selects, through the user interface 60, a desired time interval 45 to 

process, such as systole, which is a sub-interval of the cardiac cycle 46 (see Fig. 3). 

The time interval is designated by T and T , . The time interval is determined 

start end 

from a timing signal 47 generated from a timing event source 65 (Fig. 1) and/or from 
characteristic signatures of the set of signal values 41 . An example of such a timing 
signal is an electro-cardiogram (ECG) signal (see Fig. 4). Those skilled in ultrasound 
also know how to derive timing events from signals of other sources such as a 
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phonocardiogram signal, a pressure wave signal, a pulse wave signal, or a respiratory 
signal. Ultrasound modalities such as spectrum Doppler or M-modes may also be 
used to obtain timing information. 

[0029] T ^^^^ is typically selected by the operator as an offset from the R-event in the 

ECG signal. T . is set such that the time interval covers a selected portion of the 
end 

cardiac cycle such as systole. It is also possible to select a time period 45 
corresponding to the complete cardiac cycle 46. Another possibility is to limit the time 
period 45 to the systolic time period in order to display a pattern of indicia (tagging 
symbols) optimized for visualization of systolic motion. Other sub-intervals of the 
cardiac cycle 46 may also be applied. 

[0030] Fig. 3 graphically illustrates typical sets of signal values 41 for velocity 42 and 

strain rate 43 which may be segmented into desired time periods based on signature 
characteristics. For reference, the profiles in Fig. 3 are annotated with the times 
corresponding to: IVC=isovolumetric contraction, IVR=isovolumetric relaxation, 
E=early diastolic velocity, and A=late diastolic velocity. Caution should be taken in the 
selection of the time interval such that, for example, motion in the IVC or IVR period 
may be excluded from the analysis, if desired. An automatic function may be 
implemented to recognize and exclude the unwanted events from the time interval. 

[0031] In other possible embodiments, the time interval may be selected automatically or 
as a combination of manual and automatic methods. For example, the time period 45 
may be determined automatically with an algorithm 52 (see Fig. 1) embedded in host 
processor 50. The algorithm 52 may use well-known techniques of analyzing the sets 
of signal values 41 , as shown in Fig. 3, looking for key signal signature characteristics 
and defining a time period 45 based on the characteristics, or similarly, analyzing the 
ECG signal 47 (Fig. 4). 

[0032] The spatial set of signal values 41 representing the movement of the structure 
105 is sent from Doppler processor 40 to host processor 50, where a tracking 
function 1 47 is applied to the set of signal values 41 . Fig. 5 is a flow chart of the 
tracking function 147. 

[0033] 

The operator brings up onto the display and positions, through user interface 60, 
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a pattern of indicia 1 55 (a set of tagging symbols), typically configured in the form of 
parallel lines or a grid (see Fig. 6). The operator then initiates, through user interface 
60, real-time tracking of every sampled anatomical location associated with an 
element of the pattern of indicia over the selected time period 45 of the cardiac cycle 
46. The association is established by host processor 50 where each element of the 
pattern of indicia 1 55 is correlated to the anatomical locations beneath the pattern of 
indicia 1 55 at time T 

start 

[0034] introduction to the tracking function 147, a tracked velocity parameter 

profile 1 41 (V , V V ) (Fig. 7) for a given sampled anatomical location 55 in 

12 n 

the myocardium 1 05, is created over the time period T to T by converting 

start end 

the spatial set of velocity values 42 into a motion parameter profile 1 51 in time using 

host processor 50 by computing the series of time integrals (S . S ^ , ... , S ) 

1 2 n 

where: 

Si = T*(V,+V2+ . . . +Vi) [Equation 1] 
and where T is the time delay between two consecutive velocity measurements (T is 



typically based on the frame rate of the imaging mode). S . (motion parameter signal 

m ' 

« value) 1 52 (Fig. 7) is then the longitudinal distance in mm (from reference time T ^^^^ 



location) that a sample of tissue in the myocardium has moved at time segment T . , 



|4 thus allowing the isolated tissue sample to be tracked longitudinally (along the 

P'. ultrasound beam) over the time interval T to T by host processor 50. The 

js'i; start end 

3^ tracking function 147 estimates the new anatomical location of the tracked sample of 

tissue after every time segment T . . The element of the pattern of indicia 1 55 is 
displayed at that spatial location where the tracking function has determined the 
corresponding anatomical location has moved to for the next time interval T , . This is 
done for each tracked location and correlated element of the pattern of indicia in the 
image. The upper part of Fig. 7 shows a resultant tracked velocity parameter profile 
141 of an anatomical location in the image as a function of time for a complete 
cardiac cycle 46. The lower part of Fig. 7 shows the corresponding resultant 
longitudinal motion parameter profile 151 (integrated velocity profile, S ^ , S ^ , ... , S 
) of the same anatomical location in the image. Motion along the ultrasound beam 

n 

may be accurately tracked with the technique by generating the appropriate velocity 
parameter profiles for the corresponding anatomical locations. The tracked velocity 
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parameter profile 141 and motion parameter profile 1 51 for each anatomical location 
are stored In the memory of host processor 50 as arrays of values. 



Is;?? 

m 
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[0035] Two-dimensional velocity estimation may be used for accurate tracking when a 
substantial part of the motion of the structure is orthogonal to the beam. Other 
tracking techniques may be employed as well. 

[0036] The specific steps of one tracking function 1 47 are now described for a given 

anatomical location within the image, A spatial set of mean velocity signal values 42 is 
estimated so that the motion parameter signal values S . 1 52 may be calculated for 
tracking. The mean velocity values are generated by Doppler processor 40 in a well- 
known manner. 

[0037] Referring to Fig. 5, in step 142 of tracking function 147, processor 50 selects V . 

for a given anatomical location at a given spatial position in the image from a spatial 

set of velocity signal values correlated to the location of an element of the pattern of 

indicia and corresponding to time interval T . where i=l (T , is T ). 

^ i 1 start 

[0038] In step 143 of tracking function 147, processor 50 computes the motion 

parameter signal value S . 1 52 for the given anatomical location by summing mean 



M _ velocity values as follows: 



[0039] 



Si = T*(Vi+V2+ . • . +Vi) [Equation 1 ] 

(Note that for i=l, Si=T*Vi) 

In step 144 of tracking function 147, processor 50 stores V . in tracked velocity 
parameter profile array 141 and S . is stored in motion parameter profile array 1 51 
along with the current spatial position of the anatomical location. Other estimated 
parameters, such as strain rate 43, corresponding to the tracked anatomical location 
may be computed and stored in respective tracked profile arrays as well if desired 
allowing for display of the pattern of indicia 1 55, for example, overlaid onto a strain 
rate image. Strain rate is simply computed for each spatial location as it normally is in 
the SRI mode and the results of the tracking function are used to select the spatial 
strain rate values that correspond to a tracked anatomical location. 

In step 145 of tracking function 147, i is incremented by one (corresponding to 
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the next sample time, T seconds later) and the next V . is selected from the spatial set 
of velocity signal values 42 based on the motion parameter signal value S . 1 52 
previously computed and the previous spatial position of the anatomical location (S . 
represents the longitudinal spatial movement in millimeters of the anatomical location 
over time interval T . = i*T). 

[0040] Host processor 50 sends the new position information 72 of the pattern of indicia 

1 57 to display processor 80. Display processor 80 re-configures the pattern for 

display at the new positions. The new position of the pattern is updated and displayed 

after each new tracked element in the motion parameter profile array is added 

allowing a constant update of the displayed pattern within the time interval T ^^^^ to 

T , . The underlying image (e.g. B-mode image) is displayed with the updated 
end 

pattern of indicia 1 57 overlaid such that there is spatial alignment between the 
anatomical locations in the underlying image and the updated pattern of indicia. 

[0041] In step 146 of tracking function 147, the function checks to see if T has been 

end 

exceeded. If T has not been exceeded, the function proceeds back to step 143 
end 

and computes the next motion parameter signal value S . in the series using Equation 
1 . The iterative process is followed until the full arrays of the tracked velocity 
parameter profile 141 , the motion parameter profile 151, and any other desired 
parameter profile have been created and stored over the complete time interval T 
to T 

end 

[0042] The tracking function 1 47 is performed simultaneously for each anatomical 

location in the image that corresponds to an element in the pattern of indicia 1 55 (set 
of tagging symbols). 

[0043] pjg g illustrates the function of generating a display of a pattern of indicia 1 55 

(tagging symbols), in rectangular coordinate geometry, overlaid onto a B-mode image 
of cardiac tissue. The left side of Fig. 6 illustrates a 1 -dimensional pattern where 
equidistant dashed horizontal lines are used to form the pattern corresponding to 

time T and is the zero displacement position of the pattern which is positioned 

start 

by the operator. Another good candidate for the pattern would be to use an 
equidistant set of lines with constant depth in the polar geometry representation of 
the ultrasound image. Also, a 2-dimensional grid may be used, which might consist of 
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both horizontal and vertical lines. The right side of Fig. 6 illustrates the display of a 

frame within the selected time interval T to T .of the cardiac cycle where the 

start end 

positions of the elements of the pattern have been updated to visualize the 
displacement 1 56 (distance moved 1 53 and deformation 1 54) of the tracked 
anatomical locations within the cardiac structure 1 05. The pattern has been changed 
to correspond to the displacement of the heart tissue. Those skilled in the art will 
know how to program processor 50 using tracking function 147 (Fig. 5) to achieve the 
display shown in Fig. 6. 

[0044] Care should be taken by the operator to adjust the Nyquist frequency of the 

imaging mode such that aliasing does not occur. With aliasing present in the velocity 
data, erroneous tracking results occur. Alternatively, well known automatic aliasing 
correction techniques may be employed. An embodiment of the method may be 
applied to any imaging mode of the ultrasound machine 5 for moving structure (e.g. 
£1 B-mode, TVI, SRI, etc). 



3 :; 



m 

m 



[0045] In summary, certain embodiments of the present invention afford an approach to 
more easily visualize the displacement of tissue, including expansion and contraction, 
in a two-dimensional pattern overlaid onto an image of cardiac structure. While the 
invention has been described with reference to certain embodiments, it will be 
understood by those skilled in the art that various changes may be made and 
equivalents may be substituted without departing from the scope of the invention. In 
addition, many modifications may be made to adapt a particular situation or material 
to the teachings of the invention without departing from its scope. Therefore, it is 
intended that the Invention not be limited to the particular embodiment disclosed, but 
that the invention will include all embodiments falling within the scope of the 
appended claims. 
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